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ABSTRACT 

Using 33 college freshmen enrolled in a basic reading 
skills course as subjects, a study was conducted for two purposes: 
(1) to determine the effects of direct exposure to the topics of the 
selections in the New Jersey College Basic Skills Placement Test 
(NJCBSPT) on their posttest scores, and (2) to investigate whether 
students exposed to the topics would indicate awareness of this 
knowledge on a teacher-made measure — the Prior Knowledge Inventory 
(PKI). The students were divided into two groups, randomly designated 
as the experimental and control group. Both groups, taught by the 
same instructor, received the same syllabus with the same required 
texts and quizzes. The experimental group received articles on the 
topics of the NJCBSPT; to control for the Hawthorne Effect the 
control group also received supplementary articles^ similar in length 
&»d format, but unrelated to the test topics. During the last week of 
class, both groups were given the PKI. Results indicated that the 
experimental group did not do significantly better than did the 
control group. However, while the treatment variable did not affect 
the results, the reading program for both groups did show significant 
positive results. The total group went from a pretest mean of 24.06 
to a posttest mean of 29.38. (Appendixes include a list of articles 
used in the class and the Prior Knowledge Inventory.) (HOD) 
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Johnston (1983) has pointsd out that currant ways of assessing 
reading eomprehension need to be reexamined in the light of recent 
research on schema theory (Lnngeri 1964; Lsnger & Smith^BurkOf 1982| 
Mason, 1984| Wilson, 1983| Uinograd & Novell, 1985K In a mtudy 
of eighth«^raders from rural and urban populations, Johnston (1984) 
found that prior knowledge influences consprehension and can bo 
responsible for biasing the information gained from reading comprehension 
tests • 

In Fall 1963, a study was conducted with college freshmen 
enrolled in a basic skills reading course to investigate the effects 
of background knowledge on the comprehension section of the Nelson«Denny 
ReadifKi Test (N-0)« The N-4) includes eight passages selected from 
high school and college level materials representing the humanities, 
social sciences and natural and physical sciences* 

Results indicated that the experimental group (exposed to articles 
based on topics found in the N-D) performed significantly better than 
the control group (exposed to articles on a variety of topics 
unrelated to the N«0)« 

The following question arose: Are all comprehension tests 
significantly biased by prior knowledge or only those containing text 
selected from specific academic areas? 

In attempting to answer this question^ a second study was conducted 
(Fall 1984) with the New Jersey College Basic Skills Teat (NJCBSPT), 
a test which assesses students* ability to answer questions about passages 
on common, everyday topics, as the criterion measure^ 
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PURPOSES OF STUDY 

This, present study proposedt 

1, to determine the effects of direct exposure to the 
topics 01 the selections in the NXBSPT on college 
•tudentt* po8t«*te8t •cores # 
2r to investigate whether students exposed to the 

topics would indicate awareness of this knowledge on 
a teacher-made inventory* 

SUBJECTS 

The subjects were 33 college frcshimen, 17 from one section and 
16 from another section of Introduction to College Reading, a basic 
skills course* The two sections were randomly designated as the 
experimental or control group* These 33 students had raw scores below 
the state's suggested cut-off score on the reading comprehension 
section of the NXBSPT* To be sure that the two sections were equal , 
their reading comprehension subtest scores on the N-0 were subjected 
to t-test procedures* There was no statistically significant 
difference (Control: M=25*88, SD=7*86; L'xperimental: H=27*89, SD=8*55; 
t 32=2*01). 
PROCEDURES 

Both groups, taught by the same instructor , received the same 
syllabus with the same required texts and quizzes* The course organization 
was based on the framework of the text, Integrating College Study Skills 
(Sotiriou, 1984)* In addition to weekly text assignments, supplementary 
articles were provided to reinforce the skill taught in the text faee 
Appendix A)* The experimental group received articles on the topics 



ERLC 



4 



of the NJCBSPTj to control for the Havthorne Effect the control group 
also received supplementary articlesy similar in length and format ^ 
of everyday interest but unrelated to the test topics # 

During the last week of clasa^ both groups vere given the Prior 
Knowledge Inventory (PKI) (see Appendix B) to assess students* 
awareness of topics on the NJCBSPT* 
RESULTS 

To see if there were any statistically significant differences 
related to the experimental treatment, the pre-test and post-test 
scores on the comprehension subtest of the NJC6SPT were subjected to 
a repeated measures analysis of variance (Sex x Treatment x Trials)* 
The analysis of variance showed that only the main effects of sex 
and trials were significant (see Table 1)« The males (Ms29«46) did 
better than did the females (M=24«56) on the test despite condition 
or trial (see Table 2)« While the experimental group went from a 
mean of 23»80 to a mean of 30»37 and the control group went from a 
mean of 25»51 to a mean of 28»40, the differences attributable to 
the main effect of treatment were not significant (see Table 3)» The 
experimental group, which read pieces about the topics found in the 
NJCBSPT, did not do significantly better than did the control group 
which read only placebo pieceSc 

While the treatment variable did not affect the results, the 
reading program for both groups did show significant positive results* 
The total group went from a pretest mean of 24*06 to a post^-test mean 
of 29^38 

The total quantitative scores on the PKI were subjected to a two- 
way analysis of variance (sex x treatment)* The analysis of variance 



showed that only the main effect of treatment was significant (p< #01) 
(see Table A)# Students in the experimental group (Ms31#79) thought 
that they knew significantly more about the topics than did those in 
the control group (Hs26«10) (see Table 5)« 
DISCUSSION 

Johnston (1983) classified prior knowledge into three categoriees 
strategic knovledge^ content or factual knowledge and metacognitive 
knowledge. The results of this study indicate that the NJC6SPT appears 
to test the student's ability to apply prior strategic knowledge (reading 
strategies) rather than the student's content or factual knowledge. 
Exposing the experimental group to the reading topics on the NJCBSPT 
did not enable them to do better tht>n the controls on the post-test. 
Koweveri since both the experimental and control group improved significantly 
(see Table 3 ) on the NJCBSPT post-test after receiving direct instruction 
on study skills and exposure to large amounts of reading (articles ^ short 
dlorxes and novels) in their reading course ^ these results appear to 
support the research (Fitzgerald & Spiegel, 1931; Brown et al., 1977) 
which indicates that the direct teaching of particular reading strategies 
through whole-text activities helps to improve strategic knowledge 
(Johnston, 1983). 

Contrary to the results found with the N-D (a test which appears 
to measure what Johnston refers to as content or factual knowledge along 
with strategic knowledge), these results indicate that the topics used 
on the NJCBSPT are so general in nature that direct, intentional exposure to them 
will not affect test scores significantly. These topics appear to be 
more likely a part of the students' "shared common knowledge," picked 
up through television, newspapers, magazines, or general education. 
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The fact that the malea in general did better than the femalea may 
be attributed to the limit'^d sampling procedures uaedi only two 
sections^ containing a total of 1$ males vere randomly selected for 
this study* 

The PKI9 a tool used to measure metacognition (Johnston's third 
type of prior knowledge), indicated that the students in the experimental 
group were significantly more eware of their knowledge about the topics on 
NJCBSPT than were the students in the control group* However, this type 
of metacognition had no apparent effect on their test scores* 

A similar inventory was used in the Fall, 19839 study with the N-D* 
Although the experimental group did not indicate significantly higher 
levels of awareness about the N-O topics than the control group, the 
experimental group did significantly better on the N«0 test than the 
control group* 

Both studies support the theory that students' awareness of their 
knowledge is not as important as the students' actual knowledge of the 
subject or their strategic knowledge* 

IMPLICATIONS 

Teachers and administrators should be aware of what a test is 
testing* Teachers should have this understanding in order to interpret 
the test results for placement and instructional purposes* Decisions 
about placement and instruction will be different for the student who 
lacks factual and content knowledge than it will be for the student who 
has not learned to employ efficient and effective reading strategies* 

A test is useful only if the results can be interpreted in such a way 
that placement and instruction will be beneficial to the stucents* 



TABLE 1 

Analysis of Variance: Sex x Treatment x Trials 

for 

The New Jersey College Basic Skills Placement Test (NJCBSPT) 



Source of 
Variation 

Sex 

Treatment 

Sex X 
Treatment 

Unit 

Trials 

Treatment x 
Trials 

Sex X 
Trials 

Sex X Trials 
X Treatment 

Trials x 
Unit 



Sum of 
Squares 

385.729 

0.277 

0.001 



54.050 



Df 
1 
1 

1 



Mean 
Square 

385.729 

0.277 

0.001 



F 

Ratio 

4.310 

0.003 

very 
small 



Significance 
0.047 

0.500 over 



not 

2595.664 29 89.506 tested 
355.446 1 335.446 19.095 0.001 under 



54.050 2.904 0.100 



0.628 1 0.628 0.034 0.500 over 



4.270 1 4.270 0.229 0.500 over 



not 



539.810 29 18.614 tested 



8 



TABLE 2 

Means, Standard Deviations and Cell Frequency; 
Main Effect of Sex on 
The New Jersey College Basic Skills Placement Test (NJCBSPT) 

Experimental Control Total 

Females Mean 24.62 24*50 24.56 * 

S.D. 9.07 5.64 

Number 8 10 18 

Males Mean 29.55 29.41 29.46 * 

S.D. 5.79 5.77 

Number 9 6 15 

♦£< .047 
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TABLE 3 
Means for All Cells; 
Main Effect of Trials on 
The New Jersey College Basic Skills Placement Test (NJCBSPT) 



Experimental 
(N = 17) 

Control 
(N - 16) 

Total 
(N = 33) 



Trial 1 

Female Male Total 

21.50 26.11 23.80 

22.70 28.33 25.51 



Trial 2 

Female Male Total 

27.75 33.00 30.37 

26.30 30.50 28.40 



22.10 27.33 2A.06* 27.02 31.75 29.38^ 



»£< •001 
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TABLE 4 
Analysis of Variance: 
Sex X Treatment for 
Prior Knowledge Inventory (PKI) 

Source of Sum of Mean F 

Variation Squares Df Square Ratio Significance 

Sex 7.055 1 7.055 0.204 Over 0.500 

Treatment 257.729 1 257.729 7.436 0.011 
Sex x 

Treatment 36.491 1 36.659 1.053 0.314 

not 

Unit 1005. 102 29 34.659 tested 
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TABLE 5 

Means for the Prior Knowledge Inventory (PKl); 
Sex X Treatment 



Experimental Control Total 



Females Mean 30.250 26.700 28.475 

S.D. 6.274 6.430 

Number 8 10 

Males Mean 33.333 25.500 29.417 

S.D. 5.385 5.010 

Number 9 6 

Total Mean 31.792 * 26.100 » 28.946 
♦£<.01 
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Appendix A 



ARTICLES FOR RESEARCH PROJECT 
RU 107 INTRODUCTION TO COLLEGE READING 
Pall 1984 



Chapter of Text- 



Experimental 



Control 



Chapter 3 

Locating the Main Idea 
pg 33-54 



Chapter 4 
Locating Major and 
Minor Detail 
pg 55-76 



Chapter 5 
Identifying 
Organisational 
Patterns 
pg 77-102 



••A Brief History of Astrology 
in the West", ••Shakespeare •s 
Artistic Use of Astrology**, 
' Rie Coffee Table Book of 
Astrology , John Lynch, Viking 
Press, Inc., New York, 1967, 
pp. 32-35, 257-258. 



••Heavens" New Yorker j 
Oct. 11, 1982, No. 58, pg. 
39-40. 



••Making Machines Fit People^^, 
Sharon Bagley, John Carey, 
Mary Bxnino, Newsweek , 
August 29, l^fiS, Vol. 102, 
pg. 68. 

••Civil Rights: 20 Years Uterf, 
Bayard Rustin, Newswejric, 
August 29, 1983, Vol. l02, 
pg. 29. 



••On Being Female^^, Being a 
We ll Woman , Miriam Stoppard, 
liolt, ilinehart, and 
Winston, New York, 1982, pg. 
8-9 

••As More Men Learn 'To Think 
Like a Woman,* The Workplace 
Will Become A More Humane. 
Place*^, Glamour , March 
1983, Voi. 81, No. 99, 
pg. 92 



••Unforgettable Donald Duck^^, 
Maurice Zolotow, Reader 'f 
Digest , May 1984, Vol. 124, 
No. 745, pg 112-116. 



••Expanding the Kiddie Work 
Force^^ America , July 31, 
1982, Vol. 147, pg 44. 



••Pro and Con 'Relax Rules 
on Hiring Teenagers? ••'^ 
U.S. News & World Report , 
August 16, l9S^, Vol. ^3, 
pg 71-72. 



••Network Reporting: Where 
the Bias Is^ Edwin Diamond, 
Barry S. Suman, Jack Ling, 
T.V. Guide > July 7, 1984, 
pg 3-5. 

"^In Enemy Water ••, Richard 
Shepard, The New York Times 
Magazine , July 1, 1984, 
Section" 6, pp 34. 



Chapter 6 

Reading and Listening 
for Inferences 



"Peterson**, Encyclopedia of 
Jersey > Frank Gille, Beth 
Blenx, Timothy Gile, Somer- 
set Publishers, New Jersey, 
1983, pg. 198-199 



••When •Family* Will Have a New 
Definition**, U.S. & World Report , 
May 9, 1983, Vol. 94, No. 18, 
pg. A3-A4. 
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Chapter 7 

Reading Graphs and 

Tablea 

pg. 117-132 



••Can Phyllis Schlaf ly Sleep 
asy At Last**, Glamour, 



August 1982, Vol 82, pg 52. 

"Preface", Century of 
Struggle, Eleanor ^laxner. 



The Belknap Press of Harvard 
University Press, Cambridge, 
Mass., pg. vii-x. 



••...And Wee Willie Is Almost 
Two**, People Weekly , June 25, 
1984, Vol. 21, No. 84, pg. 
34-35. 



Chapter 8 
Summarising and 
Paraphrasing 
pg. 133-152 



••The Conjurer's Arf*, 
••Prologue** , Elements of 
Film , Lee R. Bobker, 
Warcourt, Brace, Jovanovich, 
Inc., New York, 1974, pg 2-7. 



Chapter 10 

Traditional Notetaking 

Techniques 

pg. 167-196 



••The Biggest Birds Do the 
Strangest Things , Lenora and 
Arthur Hornblow, New York, 
Random House, 1965, 3-5. 



"Ostrich**, A New Dictionary of 
Birds, Landsborou^ Thomson, 
Hcbraw-Hill Book Company, 
New York, 1964, pg 569-571. 

•'He's Seven Feet, 300 Pounds 
But Oscar Is Not Just Big 
Bird II, He's Meaner Than Any 
Junkyard Dog", People's 
Weekly , Vol 20, pg 53, 
August 29, 1983, pg 53. 
(supplement) 



••A Stranger Comes Home", 
David Gelman, Newsweek, 
March 19, 1984, Vol. 103, 
pg 81. 



••A Face That Really Launched 
1,000 Ships end Many More", 
John Russell ^ Smithsonian , 
July 1984, Vol, i*>, N6^A, 
pg. 47-52. 



Chapter 11 

Alternate Note-taking 

Techniques 

pg 197-212 



••Relationships and Distribut- 
ion of Modem Birds^*, Finding 
Out About Birds , William C. 
Dilger, Parents' Magazine 
Press, New York, 1967 i Pg* 
8-11. 

"Trees'*, EiiCKClQpej3ia 
Americana (supplement), pg. 
12-13. Grolier Inc.; DanburVt 
Conn., 1980, Vol. 27, pg 63. 



"An Epitootic of Rabies^*, 
Alan M. Beck, Natural History , 
July 1984, Vol 93, No. 7, pg. 
7-11. 

••These Days Animals Are Talking 
Like E.F. Hutton**, Richard 
Walkomin, Smithsonian, August 
1984, Vol 15, No 5, Pg 140. 



Chapter 12 

The SQ3R Study System 
pg. 215-234 



••Silver**, Allen A. Boraiko, ••A Splendid Light ••, Allen Borciko, 

National Geographic, September National Geographic , Mcrch 1984, 

1961, Vol. 160 No." 3, pg Vol. 165, NoT 3, Pg 335-336. 
281-287. 
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••Uses of Metals*^, ^Silver**, 
Metals ; Lady Plowden, Molly 
Bearfy, Asa Briggs, London: 
Mac Donald Educational, 1968, 

pg. 12, 46. 25 



••Comeback for a National Symbol^, 
Sharon B^s^^yi Susan Agreat, 
New/iweek , July 9, 1984, Vol. 104, 
pg 6^-65. 
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Chlipter 13 
ttoamonic Devices 
pg 237*-248 



•Titan**, Tobias Owen, Scientific 
American t February 1982, Vol 
2*6, pg 98* 

••What We We Learned About the 
Planets'* , U.S. & World Report ^ 
October 4, 1984, Vol. 93, 
pg 62-63 • 



"Mate cSelecticm'*, Ian 
Robertson, Write to Read , 
Read to Write , kcthleen'' 
f. kc Whorter, Candalene J. 
McCombs, Boston, Little, 
Brown, and Company, 1983, 
pg 65. 



Chapter 14 

Examination Strategies: 
Objective Tests 
pg. 249-265 



••Breaking Through: Women on 
the Move*^, Mary Galligan, V.S. 
News & World Report , November 
28, 1982, Vol 93, No. 22, pg 
50-53. 



••Alex Haley: From the Brink 
of Suicide to the Best Seller 
List**, Mary LMg, Improving 
College Reading (3rd Edlticm), 
Lee A. Jacobus, Harcourt, 
Brace, Jovanovicb, Inc., 1978, 
pg 35-38. 



Chapter 15 ••Mental Illness**, Encyclopedia ••WoiU.d Americanos Man Death 

Examination Strategies, Americana, Connecticut j Grbiier, Camps ••, Paul Galloway,, 

Essay and Math or 1980, Vol. 18, pg. 701 Reading .9^^^^^^?^^^?^ 

Science Tests ••Taking Depression Seriously •* iSurvival Skills (2nd kdition), 

pg 265^282 Consumer's Research Magazine , Kendall, Hunt Publishing 

Vol. 66, February 1983, pg. *36. Company 1982, pg. 219-220. 
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Appendix B.I 

Name 

Date 

Section ^ 

RLA 107 Introduction to College Reading 

Check the category which describes the amount of knowledge you have about 
the following topics: 

Great 

Deal Moderate Minimum None 

!• History of Women's Rights ^...^ _ — 

2, Paterson Silk Mill Strike ^ 

3, The Causes of Gastronology ^^^^^ ^ ^ 

4, Bird and Tree Classifications ^ 

5, Child Labor 

6, Treatment of Mental Illness _ — - 

7, The Effects of Films ^ 

8, Different Uses of Metals .^^^^^ — . 

9, Ostriches 

10. Garbology ^^^^^ 

11. Female Conditioning ^..^ - 

12. The Characteristics of Bazelles _ 

13. Female Leadership in the 80 's .......^^ — 

14. Shakespeare's Madness at Midnight — ^ 

15. Saturn's Satellite^ Titan , ^ 

16. Use of Astrological Language in 

the Past 
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